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FIELD OF THE INVENTION 



i 

This invention relates to systems and method for diagnosing the state or condition of a vehicle, e.g., 
whether the vehicle is about to rollover or is experiencing a crash and whether the vehicle has a component 
which is operating abnormally and could possibly fail resulting in a crash or severe handicap for the 
operator, and controlling a component of the vehicle in consideration of the diagnosed state or condition of 
the vehicle. 



BACKGROUND OF THE INVENTION 

Every automobile driver fears that his or her vehicle will breakdown at some unfortunate time, e.g., 
when he or she is traveling at night, during rush hour, or on a long trip away from home. To help alleviate 
that fear, certain luxury automobile manufacturers provide roadside service in the event of a breakdown. 
Nevertheless, unless the vehicle is equipped with OnStar or an equivalent service, the vehicle driver must 
still be able to get to a telephone to call for service. It is also a fact that many people purchase a new 
automobile out of fear of a breakdown with their current vehicle. This invention is primarily concerned 
with preventing breakdowns and with minimizing maintenance costs by predicting component failure that 
would lead to such a breakdown before it occurs. 

When a vehicle component begins to fail, the repair cost is frequently minimal if the impending 
failure of the component is caught early, but increases as the repair is delayed. Sometimes if a component 
in need of repair is not caught in a timely manner, the component, and particularly the impending failure 
thereof, can cause other components of the vehicle to deteriorate. One example is where the water pump 
fails gradually until the vehicle overheats and blows a head gasket. It is desirable, therefore, to determine 
that a vehicle component is about to fail as early as possible so as to minimize the probability of a 
breakdown and the resulting repair costs. 
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There are various gages on an automobile which alert the driver to various vehicle problems. For 
example, if the oil pressure drops below some predetermined level, the driver is warned to stop his vehicle 
immediately. Similarly, if the coolant temperature exceeds some predetermined value, the driver is also 
warned to take immediate corrective action. In these cases, the warning often comes too late as most 
5 vehicle gages alert the driver after he or she can conveniently solve the problem. Thus, what is needed is a 
component failure warning system that alerts the driver to the impending failure of a component sufficiently 
in advance of the time when the problem gets to a catastrophic point. 

Some astute drivers can sense changes in the performance of their vehicle and correctly diagnose 
that a problem with a component is about to occur. Other drivers can sense that their vehicle is performing 
10 differently but they don't know why or when a component will fail or how serious that failure will be, or 
possibly even what specific component is the cause of the difference in performance. The invention 
disclosed herein will, in most cases, solve this problem by predicting component failures in time to permit 
rj maintenance and thus prevent vehicle breakdowns. 

Presently, automobile sensors in use are based on specific predetermined or set levels, such as the 
iJF5 coolant temperature or oil pressure, whereby an increase above the set level or a decrease below the set 
j'^ level will activate the sensor, rather than being based on changes in this level over time. The rate at which 
Vi coolant heats up, for example, can be an important clue that some component in the cooling system is about 

to fail. There are no systems currently on automobiles to monitor the numerous vehicle components over 
-^1 time and to compare component performance with normal performance. Nowhere in the vehicle is the 
2§ vibration signal of a normally operating front wheel stored, for example, or for that matter, any normal 
\^ signal firom any other vehicle component. Additionally, there is no system currently existing on a vehicle to 
look for erratic behavior of a vehicle component and to warn the driver or the dealer that a component is 
misbehaving and is therefore likely to fail in the very near fiiture. 

Sometimes, when a component fails, a catastrophic accident results. In the Firestone tire case, for 
25 example, over 100 people were killed when a tire of a Ford Explorer blew out which caused the Ford 
Explorer to rollover. Similarly, other component failures can lead to loss of control of the vehicle and a 
subsequent accident. It is thus very important to accurately forecast that such an event will take place but 
fiirthermore, for those cases where the event takes place suddenly without warning, it is also important to 
diagnose the state of the entire vehicle, which in some cases can lead to automatic corrective action to 
30 prevent unstable vehicle motion or rollovers resulting in an accident. Finally, an accurate diagnostic 

system for the entire vehicle can determine much more accurately the severity of an automobile crash once 
it has begun by knowing where the accident is taking place on the vehicle (e.g., the part of or location on 
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the vehicle which is being impacted by an object) and what is colliding with the vehicle based on a 
knowledge of the force deflection characteristics of the vehicle at that location. Therefore, in addition to a 
component diagnostic, the teachings of this invention also provide a diagnostic system for the entire vehicle 
prior to and during accidents. In particular, this invention is concerned with the simultaneous monitoring of 
5 multiple sensors on the vehicle so that the best possible determination of the state of the vehicle can be 

determined. Current crash sensors operate independently or at most one sensor may influence the threshold 
at which another sensor triggers a deployable restraint. In the teachings of this invention, two or more 
sensors, frequently accelerometers, are monitored simultaneously and the combination of the outputs of 
these multiple sensors are combined continuously in making the crash severity analysis. 
10 Marko et al. (U.S. Pat. No. 5,041,976) is directed to a diagnostic system using pattern recognition 

for electronic automotive control systems and particularly for diagnosing faults in the engine of a motor 
vehicle afl:er they have occurred. For example, Marko et al. is interested in determining cylinder specific 
'''i faults after the cylinder is operating abnormally. More specifically, Marko et al. is directed to detecting a 
SJ fault in a vehicular electromechanical system indirectly, i.e., by means of the measurement of parameters 
;T5 of sensors which are affected by that system, and after that fault has already manifested itself in the 
system. In order to form the fault detecting system, the parameters from these sensors are input to a 

i- Li 

pattern recognition system for training thereof Then known faults are introduced and the parameters from 
the sensors are inputted into the pattern recognition system with an indicia of the known fault. Thus, 
during subsequent operation, the pattern recognition system can determine the fault of the 
1^ electromechanical system based on the parameters of the sensors, assuming that the fault was "trained" 
j;3 into the pattern recognition system and has already occurred. 

When the electromechanical system is an engine, the parameters input into the pattern recognition 
system for training thereof, and used for fault detection during operation, all relate to the engine. (If the 
electromechanical system is other than the engine, then the parameters input into the pattern recognition 
25 system would relate to that system.) In other words, each parameter will be affected by the operation of the 
engine and depend thereon and changes in the operation of the engine will alter the parameter, e.g., the 
manifold absolute pressure is an indication of the airflow into the engine. In this case, the signal from the 
manifold absolute pressure sensor may be indicative of a fault in the intake of air into the engine, e.g., the 
engine is drawing in too much or too little air, and is thus affected by the operation of the engine. 
30 Similarly, the mass air flow is the airflow into the engine and is an alternative to the manifold absolute 
pressure. It is thus a parameter that is directly associated with, related to and dependent on the engine. 
The exhaust gas oxygen sensor is also affected by the operation of the engine, and thus directly associated 
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therewith, since during normal operation, the nuxture of the exhaust gas is neither rich or lean whereas 
during abnormal engine operation, the sensor will detect an abrupt change indicative of the mixture being 
too rich or too lean. 

Thus, the system of Marko et al. is based on the measurement of sensors which affect or are affected by, 
5 i.e., are directly associated with, the operation of the electromechanical system for which faults are to be detected. 
However, the system of Marko et al. does not detect faults in the sensors that are conducting the measurements, 
e.g., a feult in the exhaust gas oxygen sensor, or feults that are only developing but have not yet manifested 
themselves or feults in other systems. Rather, the sensors are used to detect a fault in the system after it has 
occurred. 

10 Asami et al. (U.S. Pat. No. 4,817,418) is directed to a failure diagnosis system for a vehicle 

including a failure display means for displaying failure information to a driver. This system only reports 
failures after they have occurred and does not predict them. 
Q Tieman et al. (U.S. Pat. No. 5,3 13,407) is directed, inter alia, to a system for providing an exhaust 

; J active noise control system, i.e., an electronic muffler system, including an input microphone 60 which 
;l^l senses exhaust noise at a first location 61 in an exhaust duct 58. An engine has exhaust manifolds 56,57 
feeding exhaust air to the exhaust duct 58. The exhaust noise sensed by the microphone 60 is processed to 
'fi obtain an output from an output speaker 65 arranged downstream of the input microphone 61 in the 
H exhaust path in order to cancel the noise in the exhaust duct 58. 

;^ ! SchoU et al. (U.S. Pat. No. 5,400,018) is directed to a method for relaying information relating to the 

23 status of a vehicle to a remote location over a communications data link. 

r3 Haramaty et al. (U.S. Pat. No. 5,406,502) describes a system that monitors a machine in a factory 

and notifies maintenance personnel remote from the machine (not the machine operator) that maintenance 
should be scheduled at a time when the machine is not in use. Haramaty et al. does not expressly relate to 
vehicular applications. 

25 NASA Technical Support Package MFS-26529 "Engine Monitoring Based on Normalized 

Vibration Spectra", describes a technique for diagnosing engine health using a neural network based system 
and is incorporated by reference herein in its entirety. 

A paper "Using acoustic emission signals for monitoring of production processes" by H. K. 
Tonshoff et al. also provides a good description of how acoustic signals can be used to predict the state of 
30 machine tools and is incorporated by reference herein in its entirety. 

Preferred embodiments of the invention are described below and unless specifically noted, it is the 
applicant's intention that the words and phrases in the specification and claims be given the ordinary and 
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accustomed meaning to those of ordinary skill in the applicable art(s). If applicant intends any other 
meaning, he will specifically state they are applying a special meaning to a word or phrase. 

Likewise, applicant's use of the word "fimction" here is not intended to indicate that the apphcant seeks 
to invoke the special provisions of 35 U.S.C. §1 12, sixth paragraph, to define their invention. To the contrary, if 
applicant washes to invoke the provisions of 35 U.S.C. §1 12, sixth paragraph, to define their invention, he will 
specifically set forth in the claims the phrases "means for" or "step for" and a function, without also reciting in 
that phrase any structure, material or act in support of the fimction. Moreover, even if applicant invokes the 
provisions of 35 U.S.C. §112, sixth paragraph, to define his invention, it is the applicant's intention that his 
inventions not be limited to the specific structure, material or acts that are described in the preferred embodiments 
herein. Rather, if applicant claims his inventions by specifically invoking the provisions of 35 U.S.C. §1 12, sixth 
paragraph, it is nonetheless his intention to cover and include any and all structure, materials or acts that perform 
the claimed fimction, along with any and all known or later developed equivalent structures, materials or acts for 
performing the claimed fiinction. 



Accordingly, it is an object of the present invention to solve the above problems by monitoring the 
patterns of signals emitted from the vehicle components and, through the use of pattern recognition 
technology, forecasting component failures before they occur. Vehicle component behavior is monitored 
over time in contrast to currently used systems that merely wait until a serious condition occurs. 

It is another object of the present invention to provide a new and improved on-board vehicle 
diagnostic module utilizing pattern recognition technologies which are trained to differentiate normal from 
abnormal component behavior. In this manner, the problems discussed above, as well as many others, are 
alleviated by the vehicle diagnostic module described in the paragraphs below. 

It is yet another object of the present invention to provide a diagnostic module that determines 
whether a component is operating normally or abnormally based on a time series of data from a single 
sensor or fi-om multiple sensors that contain a pattern indicative of the operating status of the component. 

It is still another object of the present invention to provide a diagnostic module that determines 
whether a component is operating normally or abnormally based on data fi"om one or more sensors that are 
not directly associated with the component, i.e., do not depend on the operation of the component. 

It is an additional object of the present invention to simultaneously monitor several sensors, 
primarily accelerometers, gyroscopes and strain gages, to determine the state of the vehicle and optionally 
its occupants and to determine that a vehicle is out of control and possibly headed for an accident, for 
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example. If so, then a signal can be sent to a part of the vehicle control system to attempt to re-establish 
stability. If this is unsuccessful, then the same system of sensors can monitor the early stages. of a crash to 
make an assessment of the severity of the crash and what occupant protection systems should be deployed 
and how such occupant protection systems should be deployed. 

The diagnostic module in accordance with the invention utilizes information which already exists in 
signals emanating from various vehicle components along with sensors which sense these signals and, using 
pattern recognition techniques, compares these signals with patterns characteristic of normal and abnormal 
component performance to predict component failure, vehicle instability or a crash earlier than would 
otherwise occur if the diagnostic module was not utilized. If fully implemented, this invention is a total 
diagnostic system of the vehicle. In most implementations, the module is attached to the vehicle and 
electrically connected to the vehicle data bus where it analyzes data appearing on the bus to diagnose 
components of the vehicle. In some implementations, multiple distributed accelerometers and/or 
microphones are present on the vehicle and, in some cases, some of the sensors will communicate using 
wireless technology to the vehicle bus or directly to the diagnostic module. 

Principal objects and advantages of this invention are thus: 

1 . To prevent vehicle breakdowns. 

2. To alert the driver of the vehicle that a component of the vehicle is functioning differently 
than normal and might be in danger of failing. 

3. To alert the dealer, or other repair facility, that a component of the vehicle is functioning 
differently than normal and is in danger of failing. 

4. To provide an early warning of a potential component failure and to thereby minimize the 
cost of repairing or replacing the component. 

5. To provide a device which will capture available information from signals emanating from 
vehicle components for a variety of uses such as current and future vehicle diagnostic purposes. 

6. To provide a device that uses information from existing sensors for new purposes thereby 
increasing the value of existing sensors and, in some cases, eliminating the need for sensors that provide 
redundant information. 

7. To provide a device which is trained to recognize deterioration in the performance of a 
vehicle component, or of the entire vehicle, based on information in signals emanating from the component 
or from vehicle angular and linear accelerations. 
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8. To provide a device which analyzes vibrations from various vehicle components that are 
transmitted through the vehicle structure and sensed by existing vibration sensors such as vehicular crash 
sensors used with airbag systems or by special vibration sensors, accelerometers, or gyroscopes. 

9. To provide a device which provides information to the vehicle manufacturer of the events 
leading to a component failure. 

10. To apply pattern recognition techniques based on training to diagnosing potential vehicle 
component failures. 

11. To apply component diagnostic techniques in combination with intelligent or smart 
highways wherein vehicles may be automatically guided without manual control in order to permit the 
orderly exiting of the vehicle from a restricted roadway prior to a breakdown of the vehicle. 

12. To apply trained pattern recognition techniques using multiple sensors to provide an early 
prediction of the existence and severity of an accident. 

13. To utilize pattern recognition techniques and the output from multiple sensors to determine 
at an early stage that a vehicle rollover might occur and to take corrective action through control of the 
vehicle acceleration, brakes and steering to prevent the rollover or if it is preventable, to deploy side head 
protection airbags to reduce the injuries. 

14. To use the output from multiple sensors to determine that the vehicle is skidding or sliding 
and to send messages to the various vehicle control systems to activate the throttle, brakes and/or steering 
to correct for the vehicle sliding or skidding motion. 

Other objects and advantages of the present invention will become apparent from the following 
description of the preferred embodiments taken in conjunction with the accompanying drawings. 

SUMMARY OF THE INVENTION 

Accordingly, in one embodiment of the invention, the state of the entire vehicle is diagnosed 
whereby two or more sensors, preferably acceleration sensors and gyroscopes, detect the state of the vehicle 
and if the state is abnormal, output means are coupled to the processor means for affecting another system 
in the vehicle. The another system may be the steering control system, the brake system, the accelerator or 
the frontal or side occupant protection system. An exemplifying control system for controlling a part of the 
vehicle in accordance with the invention thus comprises a plurality of sensor systems mounted at different 
locations on the vehicle, each sensor system providing a measurement related to a state of the sensor system 
or a measurement related to a state of the mounting location, and a processor coupled to the sensor systems 
and arranged to diagnose the state of the vehicle based on the measurements of the sensor system, e.g., by 



7 

% 



the application of a pattern recognition technique. The processor controls the part based at least in part on 
the diagnosed state of the vehicle. At least one of the sensor systems may be a high dynamic range 
accelerometer or a sensor selected from a group consisting of a single axis acceleration sensor, a double 
axis acceleration sensor, a triaxial acceleration sensor and a gyroscope, and may optionally include an 
5 RFID response unit. The gyroscope may be a MEMS-IDT gyroscope including a surface acoustic wave 
resonator which applies standing waves on a piezoelectric substrate. If an RFID response unit is present, 
the control system would then comprise an RFID interrogator device which causes the RFID response 
unit(s) to transmit a signal representative of the measurement of the sensor system associated therewith to 
the processor. 

10 The state of the vehicle diagnosed by the processor may be the vehicle's angular motion, angular 

acceleration and/or angular velocity. As such, the steering system, braking system or throttle system may 
be controlled by the processor in order to maintain the stability of the vehicle. The processor can also be 
arranged to control an occupant restraint or protection device in an attempt to minimize injury to an 
occupant. 

Ll^ The state of the vehicle diagnosed by the processor may also be a determination of a location of an 

impact between the vehicle and another object. In this case, the processor can forecast the severity of the 
i/3 impact using the force/crush properties of the vehicle at the impact location and control an occupant 
" restraint or protection device based at least in part on the severity of the impact, 

i=4 The system can also include a weight sensing system coupled to a seat in the vehicle for sensing the 

?| weight of an occupying item of the seat. The weight sensing system is coupled to the processor whereby 

the processor controls deployment or actuation of the occupant restraint or protection device based on the 

state of the vehicle and the weight of the occupying item of the seat sensed by the weight sensing system. 

A display may be coupled to the processor for displaying an indication of the state of the vehicle as 

diagnosed by the processor. A warning device may be coupled to the processor for relaying a warning to an 
25 occupant of the vehicle relating to the state of the vehicle as diagnosed by the processor. Further, a 

transmission device may be coupled to the processor for transmitting a signal to a remote site relating to the 

state of the vehicle as diagnosed by the processor. 

The state of the vehicle diagnosed by the processor may include angular acceleration of the vehicle 

whereby angular velocity and angular position or orientation are derivable from the angular acceleration. 
30 The processor can then be arranged to control the vehicle's navigation system based on the angular 

acceleration of the vehicle. 
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A method for controlling a part of the vehicle in accordance with the invention comprises the step 
of mounting a plurality of sensor systems at different locations on the vehicle, measuring a state of the 
sensor system or a state of the respective mounting location of the sensor system, diagnosing the state of the 
vehicle based on the measurements of the state of the sensor systems or the state of the mounting locations 
of the sensor systems, and controlling the part based at least in part on the diagnosed state of the vehicle. 
The state of the sensor system may be any one or more of the acceleration, angular acceleration, angular 
velocity or angular orientation of the sensor system. Diagnosis of the state of the vehicle may entail 
determining whether the vehicle is stable or is about to rollover or skid and/or determining a location of an 
impact between the vehicle and another object. Diagnosis of the state of the vehicle may also entail 
determining angular acceleration of the vehicle based on the acceleration measured by accelerometers if 
multiple accelerometers are present as the sensor systems. 

Another control system for controlling a part of the vehicle in accordance with the invention 
comprises a plurality of sensor systems mounted on the vehicle, each providing a measurement of a state of 
the sensor system or a state of the mounting location of the sensor system and generating a signal 
representative of the measurement, and a pattern recognition system for receiving the signals from the 
sensor systems and diagnosing the state of the vehicle based on the measurements of the sensor systems. 
The pattern recognition system generates a control signal for controlling the part based at least in part on 
the diagnosed state of the vehicle. The pattern recognition system may comprise one or more neural 
networks. The features of the control system described above may also be incorporated into this control 
system to the extent feasible. 

The state of the vehicle diagnosed by the pattern recognition system may include a state of an 
abnormally operating component whereby the pattern recognition system is designed to identify a 
potentially malfunctioning component based on the state of the component measured by the sensor systems 
and determine whether the identified component is operating abnormally based on the state of the 
component measured by the sensor systems. 

In one preferred embodiment, the pattern recognition system may comprise a neural network 
system and the state of the vehicle diagnosed by the neural network system includes a state of an 
abnormally operating component. The neural network system includes a first neural network for 
identifying a potentially malfunctioning component based on the state of the component measured by the 
sensor systems and a second neural network for determining whether the identified component is operating 
abnormally based on the state of the component measured by the sensor systems. 
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Modular neural networks can also be used whereby the neural network system includes a first 
neural network arranged to identify a potentially malfunctioning component based on the state of the 
component measured by the sensor systems and a plurality of additional neural networks. Each of the 
additional neural networks is trained to determine whether a specific component is operating abnormally so 
that the measurements of the state of the component from the sensor systems are input into that one of the 
additional neural networks trained on a component which is substantially identical to the identified 
component. 

Another method for controlling a part of the vehicle comprises the steps of mounting a plurality of 
sensor systems on the vehicle, measuring a state of the sensor system or a state of the respective mounting 
location of the sensor system, generating signals representative of the measurements of the sensor systems, 
inputting the signals into a pattern recognition system to obtain a diagnosis of the state of the vehicle and 
controlling the part based at least in part on the diagnosis of the state of the vehicle. 

In one notable embodiment, a potentially malfunctioning component is identified by the pattern 
recognition system based on the states measured by the sensor systems and the pattern recognition system 
determine whether the identified component is operating abnormally based on the states measured by the 
sensor systems. If the pattern recognition system comprises a neural network system, identification of the 
component entails inputting the states measured by the sensor systems into a first neural network of the 
neural network system and the determination of whether the identified component is operating abnormally 
entails inputting the states measured by the sensor systems into a second neural network of the neural 
network system. A modular neural network system can also be applied in which the states measured by the 
sensor systems are input into a first neural network and a plurality of additional neural networks are 
provided, each being trained to determine whether a specific component is operating abnormally, whereby 
the states measured by the sensor systems are input into that one of the additional neural networks trained 
on a component which is substantially identical to the identified component. 

Another control system for controlling a part of the vehicle based on occupancy of the seat in 
accordance with the invention comprises a plurality of strain gages mounted in connection with the seat, 
each measuring strain of a respective mounting location caused by occupancy of the seat, and a processor 
coupled to the strain gages and arranged to determine the weight of an occupying item based on the strain 
measurements from the strain gages over a period of time, i.e., dynamic measurements. The processor 
controls the part based at least in part on the determined weight of the occupying item of the seat. The 
processor can also determine motion of the occupying item of the seat based on the strain measurements 
from the strain gages over the period of time. One or more accelerometers may be mounted on the vehicle 
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for measuring acceleration in which case, the processor may control the part based at least in part on the 
determined weight of the occupying item of the seat and the acceleration measured by the accelerometer(s). 

By comparing the output of various sensors in the vehicle, it is possible to determine activities that 
are affecting parts of the vehicle while not affecting other parts. For example, by monitoring the vertical 
5 accelerations of various parts of the vehicle and comparing these accelerations with the output of strain 
gage load cells placed on the seat support structure, a characterization can be made of the occupancy of the 
seat. Not only can the weight of an object occupying the seat be determined, but also the gross motion of 
such an object can be ascertained and thereby an assessment can be made as to whether the object is a life 
form such as a human being. Strain gage weight sensors are disclosed in co-pending U.S. patent 
10 application Ser. No. 09/193,209 filed Nov. 17, 1998 (corresponding to International Publication No. WO 
00/29257) , which is included in here in its entirety as if the entire application were printed herein, by 
reference. In particular, the inventors contemplate the combination of all of the ideas expressed in this 
patent application with those expressed in the current invention. 
•;3 As used herein, a diagnosis of the "state of the vehicle" means a diagnosis of the condition of the 

1^ vehicle with respect to its stability and proper running and operating condition. Thus, the state of the 
vy vehicle could be normal when the vehicle is operating properly on a highway or abnormal when, for 
rg example, the vehicle is experiencing excessive angular inclination (e.g., two wheels are off the ground and 

' the vehicle is about to rollover), the vehicle is experiencing a crash, the vehicle is skidding, and other 
i=j similar situations. A diagnosis of the state of the vehicle could also be an indication that one of the parts of 
2Q the vehicle, e.g., a component, system or subsystem, is operating abnormally. 

ry As used herein, an "occupant restraint device" includes any type of device which is deployable in 

the event of a crash involving the vehicle for the purpose of protecting an occupant fi*om the effects of the 
crash and/or minimizing the potential injury to the occupant. Occupant restraint devices thus include 
fi-ontal airbags, side airbags, seatbelt tensioners, knee bolsters, side curtain airbags, externally deployable 

25 airbags and the like. 

As used herein, a "part" of the vehicle includes any component, sensor, system or subsystem of the 
vehicle such as the steering system, braking system, throttle system, navigation system, airbag system , 
seatbelt retractor, air bag inflation valve, air bag inflation controller and airbag vent valve, as well as those 
listed below in the definitions of "component" and "sensor". 

30 As used herein, a "sensor system" includes any of the sensors listed below in the definition of 

"sensor" as well as any type of component or assembly of components which detect, sense or measure 
something. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The following drawings are illustrative of embodiments of the invention and are not meant to limit 
the scope of the invention as encompassed by the claims. 

FIG. 1 is a schematic illustration of a generalized component with several signals being emitted and 
transmitted along a variety of paths, sensed by a variety of sensors and analyzed by the diagnostic module 
in accordance with the invention and for use in a method in accordance with the invention. 

FIG. 2 is a schematic of one pattern recognition methodology known as a neural network which 
may be used in a method in accordance with the invention. 

FIG. 3 is a schematic of a vehicle with several components and several sensors and a total vehicle 
diagnostic system in accordance with the invention utilizing a diagnostic module in accordance with the 
invention and which may be used in a method in accordance with the invention. 

FIG. 4 is a flow diagram of information flowing fi-om various sensors onto the vehicle data bus and 
thereby into the diagnostic module in accordance with the invention with outputs to a display for notifying 
the driver, and to the vehicle cellular phone for notifying another person, of a potential component failure. 

FIG. 5 is a flow chart of the methods for automatically monitoring a vehicular component in 
accordance with the invention. 

FIG. 6 is a schematic illustration of the components used in the methods for automatically 
monitoring a vehicular component. 

FIG. 7 is a schematic of a vehicle with several accelerometers and/or gyroscopes at preferred 
locations in the vehicle. 



For the purposes herein the following terms are defined as follows: 

The term "component" refers to any part or assembly of parts which is mounted to or a part of a 
motor vehicle and which is capable of emitting a signal representative of its operating state. The following 
is a partial list of general automobile and truck components, the list not being exclusive: 

engine; 

transmission; 

brakes and associated brake assembly; 

tires; 

wheel; 
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steering wheel and steering column assembly; 

water pump; 

alternator; 

shock absorber; 
5 wheel mounting assembly; 

radiator; 

battery; 

oil pump; 

fuel pump; 
10 air conditioner compressor; 

differential gear; 

exhaust system; 
Q fan belts; 

engine valves; 

steering assembly; 

vehicle suspension including shock absorbers; 
vehicle wiring system; and 
engine cooling fan assembly, 
i'? The term "sensor" refers to any measuring or sensing device mounted on a vehicle or any of its 

2D components including new sensors mounted in conjunction with the diagnostic module in accordance with 
the invention. A partial, non-exclusive list of common sensors mounted on an automobile or truck is as 
follows: 

airbag crash sensor; 
accelerometer; 
25 microphone; 

camera; 

antenna, capacitance sensor or other electromagnetic wave sensor; 
stress or strain sensor; 
pressure sensor; 
30 weight sensor; 

magnetic field sensor; 
coolant thermometer; 
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oil pressure sensor; 

oil level sensor; 

air flow meter; 

voltmeter; 

ammeter; 

humidity sensor; 

engine knock sensor; 

oil turbidity sensor; 

throttle position sensor; 

steering wheel torque sensor; 

wheel speed sensor; 

tachometer; 

speedometer; 

other velocity sensors; 

other position or displacement sensors; 

oxygen sensor; 

yaw, pitch and roll angular sensors; 

clock; 

odometer; 

power steering pressure sensor; 
pollution sensor; 
fuel gauge ; 
cabin thermometer; 
transmission fluid level sensor; 

gyroscopes or other angular rate sensors including yaw, pitch and roll rate sensors; 

coolant level sensor; 

transmission fluid turbidity sensor; 

break pressure sensor; 

tire pressure sensor; 

tire temperature sensor, and 

coolant pressure sensor. 
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The term "signal" herein refers to any time varying output from a component including electrical, 
acoustic, thermal, or electromagnetic radiation, or mechanical vibration. 

Sensors on a vehicle are generally designed to measure particular parameters of particular vehicle 
components. However, frequently these sensors also measure outputs from other vehicle components. For 
5 example, electronic airbag crash sensors currently in use contain an accelerometer for determining the 
accelerations of the vehicle structure so that the associated electronic circuitry of the airbag crash sensor 
can determine whether a vehicle is experiencing a crash of sufficient magnitude so as to require deployment 
of the airbag. This accelerometer continuously monitors the vibrations in the vehicle structure regardless of 
the source of these vibrations. If a wheel is out of balance, or if there is extensive wear of the parts of the 

10 front wheel mounting assembly, or wear in the shock absorbers, the resulting abnormal vibrations or 
accelerations can, in many cases, be sensed by the crash sensor accelerometer. There are other cases, 
however, where the sensitivity or location of the airbag crash sensor accelerometer is not appropriate and 

'"'^ one or more additional accelerometers may be mounted onto a vehicle for the purposes of this invention. 

" J Some airbag crash sensors are not sufficiently sensitive accelerometers or have sufficient dynamic range for 
the purposes herein. 

M Every component of a vehicle emits various signals during its life. These signals can take the form 

1=5 of electromagnetic radiation, acoustic radiation, thermal radiation, vibrations transmitted through the 
1^ vehicle structure, and voltage or current fluctuations, depending on the particular component. When a 

component is fiinctioning normally, it may not emit a perceptible signal. Li that case, the normal signal is 
2@ no signal, i.e., the absence of a signal. In most cases, a component will emit signals that change over its 
i; J life and it is these changes which contain information as to the state of the component, e.g., whether failure 
of the component is impending. Usually components do not fail without warning. However, most such 
warnings are either not perceived or if perceived are not understood by the vehicle operator until the 
component actually fails and, in some cases, a breakdown of the vehicle occurs. In a few years, it is 
25 expected that various roadways will have systems for automatically guiding vehicles operating thereon. 
Such systems have been called "smart highways" and are part of the field of intelligent transportation 
systems (ITS). If a vehicle operating on such a smart highway were to breakdown, serious disruption of 
the system could result and the safety of other users of the smart highway could be endangered. 

In accordance with the invention, each of these signals emitted by the vehicle components is 
30 converted into electrical signals and then digitized (i.e., the analog signal is converted into a digital signal) 
to create numerical time series data which is then entered into a processor. Pattern recognition algorithms 
then are applied in the processor to attempt to identify and classify patterns in this time series data. For a 
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particular component, such as a tire for example, the algorithm attempts to determine from the relevant 
digital data whether the tire is functioning properly or whether it requires balancing, additional air, or 
perhaps replacement. 

Frequently, the data entered into the computer needs to be preprocessed before being analyzed by a 
5 pattern recognition algorithm. The data from a wheel speed sensor, for example, might be used as is for 
determining whether a particular tire is operating abnormally in the event it is unbalanced, whereas the 
integral of the wheel speed data over a long time period (a preprocessing step), when compared to such 
sensors on different wheels, might be more useful in determining whether a particular tire is going flat and 
therefore needs air. In some cases, the frequencies present in a set of data are a better predictor of 

10 component failures than the data itself For example, when a motor begins to fail due to worn bearings, 
certain characteristic frequencies began to appear. In most cases, the vibrations arising from rotating 
components, such as the engine, will be normalized based on the rotational frequency as disclosed in the 
NASA TSP referenced above. Moreover, the identification of which component is causing vibrations 

''4 present in the vehicle structure can frequently be accomplished through a frequency analysis of the data. 

|1 4 For these cases, a Fourier transformation of the data is made prior to entry of the data into a pattern 

recognition algorithm. Other mathematical transformations are also made for particular pattern recognition 

j^n purposes in practicing the teachings of this invention. Some of these include shifting and combining data to 

'l^ determine phase changes for example, differentiating the data, filtering the data, and sampling the data. 
Also, there exist certain more sophisticated mathematical operations that attempt to extract or highlight 

2,9 specific features of the data. This invention contemplates the use of a variety of these preprocessing 

!; 3 techniques and the choice of which ones is left to the skill of the practitioner designing a particular 
diagnostic module. 

Another technique that is contemplated for some implementations of this invention is the use of 
muhiple accelerometers and/or microphones that will allow the system to locate the source of any measured 

25 vibrations based on the time of flight and/or triangulation techniques. Once a distributed accelerometer 
installation has been implemented to permit this source location, the same sensors can be used for smarter 
crash sensing as it will permit the determination of the location of the impact on the vehicle. Once the 
impact location is known, a highly tailored algorithm can be used to accurately forecast the crash severity 
making use of a knowledge on the force vs. crush properties of the vehicle at the impact location. 

30 When a vehicle component begins to change its operating behavior, it is not always apparent from 

the particular sensors, if any, which are monitoring that component. The output from any one of these 
sensors can be normal even though the component is failing. By analyzing the output of a variety of 
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sensors, however, the pending failure can be diagnosed. For example, the rate of temperature rise in the 
vehicle coolant, if it were monitored, might appear normal unless it were known that the vehicle was idling 
and not traveling down a highway at a high speed. Even the level of coolant temperature which is in the 
normal range could be in fact abnormal in some situations signifying a failing coolant pump, for example, 
5 but not detectable from the coolant thermometer alone. 

The pending failure of some components is difificuh to diagnose and sometimes the design of the 
component requires modification so that the diagnosis can be more readily made. A fan belt, for example, 
frequently begins failing by a cracking of the inner surface. The belt can be designed to provide a sonic or 
electrical signal when this cracking begins in a variety of ways. Similarly, coolant hoses can be designed 
10 with an intentional weak spot where failure will occur first in a controlled manner that can also cause a 
whistle sound as a small amount of steam exits from the hose. This whistle sound can then be sensed by a 
general purpose microphone, for example. 
=5 In FIG. 1, a generalized component 100 emitting several signals which are transmitted along a 

'"'■■4 variety of paths, sensed by a variety of sensors and analyzed by the diagnostic device in accordance with 
jli the invention is illustrated schematically. Component 100 is mounted to a vehicle 180 and during operation 
H it emits a variety of signals such as acoustic 101, electromagnetic radiation 102, thermal radiation 103, 
current and voltage fluctuations in conductor 104 and mechanical vibrations 105. Various sensors are 
'■[^ mounted in the vehicle to detect the signals emitted by the component 100. These include one or more 
i,^ vibration sensors (accelerometers) 130,150 and/or gyroscopes also mounted to the vehicle, one or more 
2;@ acoustic sensors 1 10, 15 1, electromagnetic radiation sensor 115, heat radiation sensor 120, and voltage or 
Q current sensor 140. In addition, various other sensors 152, 153 measure other parameters of other 

components that in some manner provide information directly or indirectly on the operation of component 
100, All of the sensors illustrated on FIG. 1 can be connected to a data bus 160. A diagnostic module 170, 
in accordance with the invention, can also be attached to the vehicle data bus 160 and receives the signals 
25 generated by the various sensors. The sensors may however be wirelessly connected to the diagnostic 

module 170 and be integrated into a wireless power and communications system or a combination of wired 
and wireless connections. 

As shown in FIG. 1, the diagnostic module 170 has access to the output data of each of the sensors 
that have information relative to the component 100. This data appears as a series of numerical values 
30 each corresponding to a measured value at a specific point in time. The cumulative data from a particular 
sensor is called a time series of individual data points. The diagnostic module 170 compares the patterns of 
data received from each sensor individually, or in combination with data from other sensors, with patterns 
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for which the diagnostic module has been trained to determine whether the component is functioning 
normally or abnormally. 

Central to this invention are the manner in which the diagnostic module 170 determines a normal 
pattern from an abnormal pattern and the manner in which it decides what data to use from the vast 
5 amount of data available. This is accomplished using pattern recognition technologies such as artificial 
neural networks and training. The theory of neural networks including many examples can be found in 
several books on the subject including: Techniques And Application Of Neural Networks, edited by 
Taylor, M. and Lisboa, P., Ellis Horwood, West Sussex, England, 1993; Naturally Intelligent Systems , by 
Caudill, M. and Butler, C, MIT Press, Cambridge Massachusetts, 1990; J. M. Zaruda, Introduction to 
10 Artificial Neural Systems . West publishing Co., N.Y., 1992 and, Digital Neural Networks , by Kung, S. 
Y., PTR Prentice Hall, Englewood Cliffs, New Jersey, 1993, all of which are included herein by reference. 
The neural network pattern recognition technology is one of the most developed of pattern recognition 
O. technologies. The neural network will be used here to illustrate one example of a pattern recognition 
"1 technology but it is emphasized that this invention is not limited to neural networks. Rather, the invention 
13 may apply any known pattern recognition technology including sensor fusion and various correlation 
n technologies. A brief description of the neural network pattern recognition technology is set forth below. 

Neural networks are constructed of processing elements known as neurons that are interconnected 
using information channels call interconnects. Each neuron can have multiple inputs but only one output. 
'•^ Each output however is usually connected to all other neurons in the next layer. The neurons in the first 
2(J layer operate collectively on the input data as described in more detail below. Neural networks learn by 
1^5 extracting relational information from the data and the desired output. Neural networks have been applied 
1=-^ to a wide variety of pattern recognition problems including automobile occupant sensing, speech 
recognition, optical character recognition, and handwriting analysis. 

To train a neural network, data is provided in the form of one or more time series that represents 
25 the condition to be diagnosed as well as normal operation. As an example, the simple case of an out of 
balance tire will be used. Various sensors on the vehicle can be used to extract information from signals 
emitted by the tire such as an accelerometer, a torque sensor on the steering wheel, the pressure output of 
the power steering system, a tire pressure monitor or tire temperature monitor. Other sensors that might 
not have an obvious relationship to tire unbalance are also included such as, for example, the vehicle 
30 speed or wheel speed. Data is taken from a variety of vehicles where the tires were accurately balanced 
under a variety of operating conditions also for cases where varying amounts of unbalance was 
intentionally introduced. Once the data had been collected, some degree of preprocessing or feature 
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extraction is usually performed to reduce the total amount of data fed to the neural network. In the case of 
the unbalanced tire, the time period between data points might be chosen such that there are at least ten 
data points per revolution of the wheel. For some other application, the time period might be one minute 
or one millisecond. 

Once the data has been collected, it is processed by a neural network-generating program, for 
example, if a neural network pattern recognition system is to be used. Such programs are available 
commercially, e.g., from NeuralWare of Pittsburgh, Pennsylvania. The program proceeds in a trial and 
error manner until it successfully associates the various patterns representative of abnormal behavior, an 
unbalanced tire, with that condition. The resulting neural network can be tested to determine if some of 
the input data from some of the sensors, for example, can be eliminated. In this way, the engineer can 
determine what sensor data is relevant to a particular diagnostic problem. The program then generates an 
algorithm that is programmed onto a microprocessor, microcontroller, neural processor, or DSP (herein 
collectively referred to as a microprocessor or processor). Such a microprocessor appears inside the 
diagnostic module 170 in FIG. 1. Once trained, the neural network, as represented by the algorithm, will 
now recognize an unbalanced tire on a vehicle when this event occurs. At that time, when the tire is 
unbalanced, the diagnostic module 170 will output a message to the driver indicating that the tire should 
be now be balanced as described in more detail below. The message to the driver is provided by output 
means coupled to or incorporated within the module 170 and may be, e.g., a light on the dashboard, a 
vocal tone or any other recognizable indication apparatus. 

It is important to note that there may be many neural networks involved in a total vehicle 
diagnostic system. These can be organized either in parallel, series, as an ensemble, cellular neural 
network or as a modular neural network system. In one implementation of a modular neural network, a 
primary neural network identifies that there is an abnormality and tries to identify the likely source. Once 
a choice has been made as to the likely source of the abnormality, another of a group of neural networks is 
called upon to determine the exact cause of the abnormality. In this maimer, the neural networks are 
arranged in a tree pattern with each neural network trained to perform a particular pattern recognition 
task. 

Discussions on the operation of a neural network can be found in the above references on the 
subject and are well understood by those skilled in the art. Neural networks are the most well known of 
the pattern recognition technologies based on training, although neural networks have only recently 
received widespread attention and have been applied to only very limited and specialized problems in 
motor vehicles. Other non-training based pattern recognition technologies exist, such as fuzzy logic. 
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However, the programming required to use fuzzy logic, where the patterns must be determine by the 
programmer, render these systems impractical for general vehicle diagnostic problems such as described 
herein. Therefore, preferably the pattern recognition systems that learn by training are used herein. 

The neural network is the first highly successful of what will be a variety of pattern recognition 
5 techniques based on training. There is nothing that suggests that it is the only or even the best technology. 
The characteristics of all of these technologies which render them applicable to this general diagnostic 
problem include the use of time-based input data and that they are trainable. In all cases, the pattern 
recognition technology learns from examples of data characteristic of normal and abnormal component 
operation. 

10 A diagram of one example of a neural network used for diagnosing an unbalanced tire, for 

example, based on the teachings of this invention is shown in FIG. 2. The process can be programmed to 
periodically test for an unbalanced tire. Since this need be done only infrequently, the same processor can 

□ be used for many such diagnostic problems. When the particular diagnostic test is run, data from the 

;i previously determined relevant sensors is preprocessed and analyzed with the neural network algorithm. 

1-5 For the unbalanced tire, using the data from an accelerometer for example, the digital acceleration values 

i,^ from the analog to digital converter in the accelerometer are entered into nodes I through n and the neural 
network algorithm compares the pattern of values on nodes 1 through n with patterns for which it has been 

IE trained as follows. 

Each of the input nodes is connected to each of the second layer nodes, h-I,h-2,...,h-n, called the 

2p hidden layer, either electrically as in the case of a neural computer, or through mathematical functions 
containing multiplying coefficients called weights, in the manner described in more detail in the above 
references. At each hidden layer node, a summation occurs of the values from each of the input layer 
nodes, which have been operated on by functions containing the weights, to create a node value. 
Similarly, the hidden layer nodes are in like manner cormected to the output layer node(s), which in this 

25 example is only a single node 0 representing the decision to notify the driver of the unbalanced tire. 

During the training phase, an output node value of 1, for example, is assigned to indicate that the driver 
should be notified and a value of 0 is assigned to not doing so. Once again, the details of this process are 
described in above-referenced texts and will not be presented in detail here. 

In the example above, twenty input nodes were used, five hidden layer nodes and one output layer 

30 node. In this example, only one sensor was considered and accelerations from only one direction were 
used. If other data from other sensors such as accelerations from the vertical or lateral directions were 
also used, then the number of input layer nodes would increase. Again, the theory for determining the 
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complexity of a neural network for a particular application has been the subject of many technical papers 
and will not be presented in detail here. Determining the requisite complexity for the example presented 
here can be accomplished by those skilled in the art of neural network design. 

Briefly, the neural network described above defines a method, using a pattern recognition system, 
of sensing an unbalanced tire and determining whether to notify the driver and comprises the steps of: 

(a) obtaining an acceleration signal from an accelerometer mounted on a vehicle; 

(b) converting the acceleration signal into a digital time series; 

(c) entering the digital time series data into the input nodes of the neural network; 

(d) performing a mathematical operation on the data from each of the input nodes and 
inputting the operated on data into a second series of nodes wherein the operation performed on each of 
the input node data prior to inputting the operated on value to a second series node is different from that 
operation performed on some other input node data; 

(e) combining the operated on data from all of the input nodes into each second series node to 
form a value at each second series node; 

(f) performing a mathematical operation on each of the values on the second series of nodes 
and inputting this operated on data into an output series of nodes wherein the operation performed on 
each of the second series node data prior to inputting the operated on value to an output series node is 
different from that operation performed on some other second series node data; 

(g) combining the operated on data from all of the second series nodes into each output series 
node to form a value at each output series node; and, 

(h) notifying a driver if the value on one output series node is within a chosen range 
signifying that a tire requires balancing. 

This method can be generalized to a method of predicting that a component of a vehicle will fail 
comprising the steps of 

(a) sensing a signal emitted from the component; 

(b) converting the sensed signal into a digital time series; 

(c) entering the digital time series data into a pattern recognition algorithm; 

(d) executing the pattern recognition algorithm to determine if there exists within the digital 
time series data a pattern characteristic of abnormal operation of the component; and 

(e) notifying a driver if the abnormal pattern is recognized. 

The particular neural network described and illustrated above contains a single series of hidden 
layer nodes. In some network designs, more than one hidden layer is used, although only rarely will more 
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than two such layers appear. There are of course many other variations of the neural network architecture 
illustrated above which appear in the referenced literature. For the purposes herein, therefore, "neural 
network" will be defined as a system wherein the data to be processed is separated into discrete values 
which are then operated on and combined in at least a two stage process and where the operation 
5 performed on the data at each stage is in general different for each discrete value and where the operation 
performed is at least determined through a training process. 

The implementation of neural networks can take on at least two forms, an algorithm programmed 
on a digital microprocessor, DSP or in a neural computer. In this regard, it is noted that neural computer 
chips are now becoming available. 

10 In the example above, only a single component failure was discussed using only a single sensor 

since the data from the single sensor contains a pattern which the neural network was trained to recognize 
as either normal operation of the component or abnormal operation of the component. The diagnostic 

□ module 170 contains preprocessing and neural network algorithms for a number of component failures. 

'r\ The neural network algorithms are generally relatively simple, requiring only a few lines of computer 

13 code. A single general neural network program can be used for multiple pattern recognition cases by 

i2 specifying different coefficients for the various terms, one set for each application. Thus, adding different 
diagnostic checks has only a small affect on the cost of the system. Also, the system has available to it all 
of the information available on the data bus. During the training process, the pattern recognition program 

'^"^ sorts out from the available vehicle data on the data bus or from other sources, those patterns that predict 

20 failure of a particular component. 

1=5 In FIG. 3, a schematic of a vehicle with several components and several sensors is shown in their 

H approximate locations on a vehicle along with a total vehicle diagnostic system in accordance with the 
invention utilizing a diagnostic module in accordance with the invention. A flow diagram of information 
passing from the various sensors shown on FIG. 3 onto the vehicle data bus and thereby into the diagnostic 

25 device in accordance with the invention is shown in FIG. 4 along with outputs to a display for notifying the 
driver and to the vehicle cellular phone, or other communication device, for notifying the dealer, vehicle 
manufacturer or other entity concerned with the failure of a component in the vehicle. If the vehicle is 
operating on a smart highway, for example, the pending component failure information may also be 
communicated to a highway control system and/or to other vehicles in the vicinity so that an orderly exiting 

30 of the vehicle from the smart highway can be facilitated. FIG. 4 also contains the names of the sensors 
shown numbered on FIG. 3. 
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Sensor 1 is a crash sensor having an accelerometer (alternately one or more dedicated 
accelerometers can be used), sensor 2 is represents one or more microphones, sensor 3 is a coolant 
thermometer, sensor 4 is an oil pressure sensor, sensor 5 is an oil level sensor, sensor 6 is an air flow 
meter, sensor 7 is a voltmeter, sensor 8 is an ammeter, sensor 9 is a humidity sensor, sensor 10 is an engine 
5 knock sensor, sensor 1 1 is an oil turbidity sensor, sensor 12 is a throttle position sensor, sensor 13 is a 
steering torque sensor, sensor 14 is a wheel speed sensor, sensor 15 is a tachometer, sensor 16 is a 
speedometer, sensor 17 is an oxygen sensor, sensor 18 is a pitch/roll sensor, sensor 19 is a clock, sensor 20 
is an odometer, sensor 21 is a power steering pressure sensor, sensor 22 is a pollution sensor, sensor 23 is 
a fuel gauge, sensor 24 is a cabin thermometer, sensor 25 is a transmission fluid level sensor, sensor 26 is a 

10 yaw sensor, sensor 27 is a coolant level sensor, sensor 28 is a transmission fluid turbidity sensor, sensor 29 
is brake pressure sensor and sensor 30 is a coolant pressure sensor. Other possible sensors include a 
temperature transducer, a pressure transducer, a liquid level sensor, a flow meter, a position sensor, a 

I J velocity sensor, a RPM sensor, a chemical sensor and an angle sensor, angular rate sensor or gyroscope. 



il^ of the location of a vibration source, the same group can, in some cases, also be used to measure the pitch, 

! _ = 

\2 yaw and/or roll of the vehicle eliminating the need for dedicated angular rate sensors. In addition, as 

mentioned above, such a suite of sensors can also be used to determine the location and severity of a vehicle 
crash and additionally to determine that the vehicle is on the verge of rolling over. Thus, the same suite of 
accelerometers optimally performs a variety of functions including inertial navigation, crash sensing, 

2® vehicle diagnostics, roll over sensing etc. 

'.zZ Consider now some examples. The following is a partial list of potential component failures and 

the sensors from the list on FIG. 4 that might provide information to predict the failure of the component: 



If a distributed group of acceleration sensors or accelerometers are used to permit a determination 




Out of balance tires 



1,13,14,15,20,21 



Front end out of alignment 



1,13,21,26 
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Tune up required 
Oil change needed 



1,3,10,12,15,17,20,22 



3,4,5,11 



Motor failure 



1,2,3,4,5,6,10,12,15,17,22 



Low tire pressure 



1,13,14,15,20,21 



Front end looseness 



1,13,16,21,26 
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Cooling system failure 
Alternator problems 
Transmission problems 



3,15,24,27,30 



1,2,7,8,15,19,20 



1,3,12,15,16,20,25,28 
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Differential problems 1,12,14 
Brakes 1,2,14,18,20,26,29 
Catalytic converter and muffler 1,2,12,15,22 
Ignition 1,2,7,8,9,10,12,17,23 
5 Tire wear 1,13,14,15,1 8,20,2 1 ,26 

Fuel leakage 20,23 
Fan belt slippage 1 ,2,3,7,8, 12,15,1 9,20 

Alternator deterioration 1,2,7,8,15,19 
Coolant pump failure 1,2,3,24,27,30 
10 Coolant hose failure 1,2,3,27,30 

Starter failure 1,2,7,8,9,12,15 
_ Dirty air filter 2,3,6,11,12,17,22 

p Several interesting facts can be deduced fi-om a review of the above list. First, all of the failure 

l'"^ modes listed can be at least partially sensed by multiple sensors. In many cases, some of the sensors 
iir5 merely add information to aid in the interpretation of signals received fi'om other sensors. Li today's 
i'7 automobile, there are few if any cases where multiple sensors are used to diagnose or predict a problem. In 
W fact, there is virtually no failure prediction undertaken at all. Second, many of the failure modes listed 

require information from more than one sensor. Third, information for many of the failure modes listed can 
not be obtained by observing one data point in time as is now done by most vehicle sensors. Usually an 
2§ analysis of the variation in a parameter as a function of time is necessary. In fact, the association of data 
[J^ with time to create a temporal pattern for use in diagnosing component failures in automobile is unique to 
this invention as in the combination of several such temporal patterns. Fourth, the vibration measuring 
capability of the airbag crash sensor, or other accelerometer, is useful for most of the cases discussed 
above yet there is no such current use of accelerometers. The airbag crash sensor is used only to detect 
25 crashes of the vehicle. Fifth, the second most used sensor in the above list, a microphone, does not 
currently appear on any automobiles yet sound is the signal most often used by vehicle operators and 
mechanics to diagnose vehicle problems. Another sensor that is listed above which also does not currently 
appear on automobiles is a pollution sensor. This is typically a chemical sensor mounted in the exhaust 
system for detecting emissions from the vehicle. It is expected that this and other chemical sensors will be 
30 used more in the future. 

In addition, from the foregoing depiction of different sensors which receive signals from a plurality 
of components, it is possible for a single sensor to receive and output signals from a plurality of 
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components which are then analyzed by the processor to determine if any one of the components for which 
the received signals were obtained by that sensor is operating in an abnormal state. Likewise, it is also 
possible to provide for a multiplicity of sensors each receiving a different signal related to a specific 
component which are then analyzed by the processor to determine if that component is operating in an 
abnormal state. Note that neural networks can simultaneously analyze data fi-om multiple sensors of the 
same type or different types. 

The discussion above has centered on notifying the vehicle operator of a pending problem with a 
vehicle component. Today, there is great competition in the automobile marketplace and the manufacturers 
and dealers who are most responsive to customers are likely to benefit by increased sales both fi"om repeat 
purchasers and new customers. The diagnostic module disclosed herein benefits the dealer by making him 
instantly aware, through the cellular telephone system, or other communication link, coupled to the 
diagnostic module or system in accordance with the invention, when a component is likely to fail. As 
envisioned, on some automobiles, when the diagnostic module 170 detects a potential failure it not only 
notifies the driver through a display 210, but also automatically notifies the dealer through a vehicle 
cellular phone 220. The dealer can thus contact the vehicle owner and schedule an appointment to 
undertake the necessary repair at each party's mutual convenience. The customer is pleased since a 
potential vehicle breakdown has been avoided and the dealer is pleased since he is likely to perform the 
repair work. The vehicle manufacturer also benefits by early and accurate statistics on the failure rate of 
vehicle components. This early warning system can reduce the cost of a potential recall for components 
having design defects. It could even have saved lives if such a system had been in place during the 
Firestone tire failure problem mentioned above. The vehicle manufacturer will thus be guided toward 
producing higher quality vehicles thus improving his competitiveness. Finally, experience with this system 
will actually lead to a reduction in the number of sensors on the vehicle since only those sensors that are 
successfiil in predicting failures will be necessary. 

For most cases it is sufficient to notify a driver that a component is about to fail through a warning 
display. In some critical cases, action beyond warning the driver may be required. If, for example, the 
diagnostic module detected that the alternator was beginning to fail, in addition to warning the driver of this 
eventuality, the module could send a signal to another vehicle system to turn off all non-essential devices 
which use electricity thereby conserving electrical energy and maximizing the time and distance that the 
vehicle can travel before exhausting the energy in the battery. Additionally, this system can be coupled to a 
system such as OnStar or a vehicle route guidance system, and the driver can be guided to the nearest open 
repair facility or a facility of his or her choice. 
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In the discussion above, the diagnostic module of this invention assumes that a vehicle data bus 
exists which is used by all of the relevant sensors on the vehicle. Most vehicles today do not have a data 
bus although it is widely believed that most vehicles will have one in the near future. Naturally, the 
relevant signals can be transmitted to the diagnostic module through a variety of coupling means other than 
through a data bus and this invention is not limited to vehicles having a data bus. For example, the data 
can be sent wirelessly to the diagnostic module using the Bluetooth specification. In some cases, even the 
sensors do not have to be wired and can obtain their power via RF from the interrogator as is well known in 
the RFID (radio frequency identification) field. Ahemately an inductive or capacitive power transfer 
system can be used. 

As can be appreciated from the above discussion, the invention described herein brings several new 
improvements to automobiles including, but not limited to, the use of pattern recognition technologies to 
diagnose potential vehicle component failures, the use of trainable systems thereby eliminating the need of 
complex and extensive programming, the simultaneous use of multiple sensors to monitor a particular 
component, the use of a single sensor to monitor the operation of many vehicle components, the monitoring 
of vehicle components which have no dedicated sensors, and the notification of both the driver and possibly 
an outside entity of a potential component failure in time so that the failure can be averted and vehicle 
breakdowns substantially eliminated. Additionally, improvements to the vehicle stability, crash avoidance, 
crash anticipation and occupant protection are available. 

To implement a component diagnostic system for diagnosing the component utilizing a plurality of 
sensors not directly associated with the component, i.e., independent of the component, a series of tests are 
conducted. For each test, the signals received from the sensors are input into a pattern recognition training 
algorithm with an indication of whether the component is operating normally or abnormally (the 
component being intentionally altered to provide for abnormal operation). The data from the test are used 
to generate the pattern recognition algorithm, e.g., neural network, so that in use, the data from the sensors 
is input into the algorithm and the algorithm provides an indication of abnormal or normal operation of the 
component. Also, to provide a more versatile diagnostic module for use in conjunction with diagnosing 
abnormal operation of multiple components, tests may be conducted in which each component is operated 
abnormally while the other components are operating normally, as well as test in which two or more 
components are operating abnormally. In this manner, the diagnostic module may be able to determine 
based on one set of signals from the sensors during use that either a single component or multiple 
components are operating abnormally. 
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Furthermore, the pattern recognition algorithm may be trained based on pattern within the signals 
from the sensors. Thus, by means of a single sensor, it would be possible to determine whether one or 
more components are operating abnormally. To obtain such a pattern recognition algorithm, tests are 
conducted using a single sensor, such as a microphone, and causing abnormal operation of one or more 
components, each component operating abnormally while the other components operate normally and 
multiple components operating abnormally. In this manner, in use, the pattern recognition algorithm may 
analyze a signal from a single sensor and determine abnormal operation of one or more components. Note 
that in some cases, simulations can be used to analytically generate the relevant data. 

The invention is also particularly usefiil in light of the foreseeable implementation of smart 
highways. Smart highways will result in vehicles traveling down highways under partial or complete 
control of an automatic system, i.e., not being controlled by the driver. The on-board diagnostic system 
will thus be able to determine failure of a component prior to or upon failure thereof and inform the 
vehicle's guidance system to cause the vehicle to move out of the stream of traffic, i.e., onto a shoulder of 
the highway, in a safe and orderly manner. Moreover, the diagnostic system may be controlled or 
programmed to prevent the movement of the disabled vehicle back into the stream of traffic until the repair 
of the component is satisfactorily completed. 

In a method in accordance with this embodiment, the operation of the component would be 
monitored and if abnormal operation of the component is detected, e.g., by any of the methods and 
apparatus disclosed herein (although other component failure systems may of course be used in this 
implementation), the guidance system of the vehicle which controls the movement of the vehicle would be 
notified, e.g., via a signal from the diagnostic module to the guidance system, and the guidance system 
would be programmed to move the vehicle out of the stream of traffic, or off of the restricted roadway, 
possibly to a service station or dealer, upon reception of the particular signal from the diagnostic module. 
The automatic guidance systems for vehicles traveling on highways may be any existing system or system 
being developed, such as one based on satellite positioning techniques or ground-based positioning 
techniques. Since the guidance system may be programmed to ascertain the vehicle's position on the 
highway, it can determine the vehicle's current position, the nearest location out of the stream of traffic, or 
off of the restricted roadway, such as an appropriate shoulder or exit to which the vehicle may be moved, 
and the path of movement of the vehicle from the current position to the location out of the stream of 
traffic, or off of the restricted roadxyay. The vehicle may thus be moved along this path under the control 
of the automatic guidance system. In the alternative, the path may be displayed to a driver and the driver 
can follow the path, i.e., manually control the vehicle. The diagnostic module and/or guidance system may 
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be designed to prevent re-entry of the vehicle into the stream of traffic, or off of the restricted roadway, 
until the abnormal operation of the component is satisfactorily addressed. 

FIG. 5 is a flow chart of some of the methods for directing a vehicle off of a roadway if a 
component is operating abnormally. The component's operation is monitored at 40 and a determination is 
made at 42 whether its operation is abnormal. If not, the operation of the component is monitored further. 
If the operation of the component is abnormal, the vehicle can be directed off the roadway at 44. More 
particularly, this can be accomplished by generating a signal indicating the abnormal operation of the 
component at 46, directing this signal to a guidance system in the vehicle at 48 that guides movement of 
the vehicle off of the roadway at 50. Also, if the component is operating abnormally, the current position 
of the vehicle and the location of a site off of the roadway can be determined at 52, e.g., using satellite- 
based or ground-based location determining techniques, a path from the current location to the ofF- 
roadway location determined at 54 and then the vehicle directed along this path at 56. Periodically, a 
determination is made at 58 whether the component's abnormality has been satisfactorily addressed and/or 
corrected and if so, the vehicle can re-enter the roadway and operation of the component begins again. ^ If 
not, the re-entry of the vehicle onto the roadway is prevented at 60. 

FIG. 6 schematically shows the basic components for performing this method, i.e., a component 
operation monitoring system 62 (such as described above), an optional satellite-based or ground-based 
positioning system 64 and a vehicle guidance system 66. 

FIG. 7 illustrates the placement of a variety of sensors, primarily accelerometers and/or 
gyroscopes, which can be used to diagnose the state of the vehicle itself Sensor 201 can measure the 
acceleration of the firewall or instrument panel and is located thereon generally midway between the two 
sides of the vehicle. Sensor 202 can be located in the headliner or attached to the vehicle roof above the 
side door. Typically, there will be two such sensors one on either side of the vehicle. Sensor 203 is shown 
in a typical mounting location midway between the sides of the vehicle attached to or near the vehicle roof 
above the rear window. Sensor 206 is shown in a typical mounting location in the vehicle trunk adjacent 
the rear of the vehicle. Either one, two or three such sensors can be used depending on the application. If 
three such sensors are use one would be adjacent each side of vehicle and one in the center. Sensor 204 is 
shown in a typical mounting location in the vehicle door and sensor 205 is shown in a typical mounting 
location on the sill or floor below the door. Finally, sensor 207, which can be also multiple sensors, is 
shown in a typical mounting location forward in the crush zone of the vehicle. If three such sensors are 
used, one would be adjacent each vehicle side and one in the center. 
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In general, sensors 201-207 provide a measurement of the state of the sensor, such as its velocity, 
acceleration, angular orientation or temperature, or a state of the location at which the sensor is mounted. 
Thus, measurements related to the state of the sensor would include measurements of the acceleration of the 
sensor, measurements of the temperature of the mounting location as well as changes in the state of the 
sensor and rates of changes of the state of the sensor. As such, any described use or function of the 
sensors 201-207 above is merely exemplary and is not intended to limit the form of the sensor or its 
function. 

Each of the sensors 201-207 may be single axis, double axis or triaxial accelerometers and/or 
gyroscopes typically of the MEMS type. These sensors 201-207 can either be wired to the central control 
module or processor directly wherein they would receive power and transmit information, or they could be 
connected onto the vehicle bus or, in some cases, using RFID technology, the sensors can be wireless and 
would receive their power through RF from one or more interrogators located in the vehicle. In this case, 
the interrogators can be connected either to the vehicle bus or directly to control module. Alternately, an 
inductive or capacitive power and information transfer system can be used. 

One particular implementation will now be described. In this case, each of the sensors 20 1-207 is 
a single or dual axis accelerometer. They are made using silicon micromachined technology such as 
disclosed in U.S. Pat. Nos. 5, 121,180 and 5,894,090. These are only representative patents of these 
devices and there exist more than 100 other relevant U.S. patents describing this technology. Commercially 
available MEMS gyroscopes such as from Systron Doner have accuracies of approximately one degree per 
second. In contrast, optical gyroscopes typically have accuracies of approximately one degree per hour. 
Unfortunately, the optical gyroscopes are prohibitively expensive for automotive applications. On the other 
hand, typical MEMS gyroscopes are not sufficiently accurate for many control applications. 

The angular rate function can be obtained through placing accelerometers at two separated, non- 
co-located points in a vehicle and using the differential acceleration to obtain an indication of angular 
motion and angular acceleration. From the variety of accelerometers shown on FIG. 7, it can be readily 
appreciated that not only will all accelerations of key parts of the vehicle be determined, but the pitch, yaw 
and roll angular rates can also be determined based on the accuracy of the accelerometers. By this method, 
low cost systems can be developed which, although not as accurate as the optical gyroscopes, are 
considerably more accurate than conventional MEMS gyroscopes. 

Instead of using two accelerometers are separate locations on the vehicle, a single conformal 
MEMS-IDT gyroscope may be used. Such a conformal MEMS-IDT gyroscope is describes in a paper by 
V.K. Karadan, Conformal MEMS-IDT Gyroscopes and Their Comparison With Fiber Optic Gyro, 
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incorporated in its entirety herein. The MEMS-IDT gyroscope is based on the principle of surface acoustic 
wave (SAW) standing waves on a piezoelectric substrate. A surface acoustic wave resonator is used to 
create standing waves inside a cavity and the particles at the anti-nodes of the standing waves experience 
large amplitude of vibrations, which serves as the reference vibrating motion for the gyroscope. Arrays of 
5 metallic dots are positioned at the anti-node locations so that the effect of Coriolis force due to rotation will 
acoustically amplify the magnitude of the waves. Unlike other MEMS gyroscopes, the MEMS-IDT 
gyroscope has a planar configuration with no suspended resonating mechanical structures. 

The system of FIG. 7 using dual axis accelerometers, therefore provide a complete diagnostic 
system of the vehicle itself and its dynamic motion. Such a system is far more accurate than any system 

10 currently available in the automotive market. This system provides very accurate crash discrimination 
since the exact location of the crash can be determined and, coupled with a knowledge of the force 
deflection characteristics of the vehicle at the accident impact site, an accurate determination of the crash 

: 3 severity and thus the need for occupant restraint deployment can be made. Similarly, the tendency of a 

vehicle to roll over can be predicted in advance and signals sent to the vehicle steering, braking and throttle 

11 systems to attempt to ameliorate the rollover situation or prevent it. In the event that it cannot be 
;:I prevented, the deployment side curtain airbags can be initiated in a timely manner. 

ijl Similarly, the tendency of the vehicle to the slide or skid can be considerably more accurately 

determined and again the steering, braking and throttle systems commanded to minimize the unstable 
vehicle behavior. 

2§ Thus, through the sample deployment of inexpensive accelerometers at a variety of locations in the 

)^ vehicle, significant improvements are many in the vehicle stability control, crash sensing, rollover sensing, 
and resulting occupant protection technologies. 

Finally, as mentioned above, the combination of the outputs from these accelerometer sensors and 
the output of strain gage weight sensors in a vehicle seat, or in or on a support structure of the seat, can be 

25 used to make an accurate assessment of the occupancy of the seat and differentiate between animate and 
inanimate occupants as well as determining where in the seat the occupants are sitting. This can be done 
by observing the acceleration signals from the sensors of FIG. 7 and simultaneously the dynamic strain 
gage measurements from seat mounted strain gages. The accelerometers provide the input function to the 
seat and the strain gages measure the reaction of the occupying item to the vehicle acceleration and thereby 

30 provide a method of determining dynamically the mass of the occupying item and its location. This is 

particularly important during occupant position sensing during a crash event. By combining the outputs of 
the accelerometers and the strain gages and appropriately processing the same, the mass and weight of an 
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object occupying the seat can be determined as well as the gross motion of such an object so that an 
assessment can be made as to whether the object is a life form such as a human being. 

For this embodiment, sensor 208 represents one or more strain gage weight sensors mounted on the 
seat or in connection with the seat or its support structure. Suitable mounting locations and forms of 
weight sensors are discussed in the current assignee's U.S. patent application Ser. No. 09/193,209 and 
contemplated for use in this invention as well. The mass or weight of the occupying item of the seat can 
thus be measured based on the dynamic measurement of the strain gages with optional consideration of the 
measurements of accelerometers on the vehicle, which are represented by any of sensors 201-207. 

Thus, discussed above is an embodiment of a component diagnostic system for diagnosing the 
component in accordance with the invention which comprises a plurality of sensors not directly associated 
with the component, i.e., independent therefrom, such that the component does not directly affect the 
sensors, each sensor detecting a signal containing information as to whether the component is operating 
normally or abnormally and outputting a corresponding electrical signal, processor means coupled to the 
sensors for receiving and processing the electrical signals and for determining if the component is operating 
abnormally based on the electrical signals, and output means coupled to the processor means for affecting 
another system within the vehicle if the component is operating abnormally. The processor means 
preferably comprise pattern recognition means such as a trained pattern recognition algorithm, a neural 
network, modular neural networks or an ensemble of neural networks. In some cases, fuzzy logic will be 
used which can be combined with a neural network to form a neural fuzzy algorithm. The another system 
may be a display for indicating the abnormal state of operation of the component arranged in a position in 
the vehicle to enable a driver of the vehicle to view the display and thus the indicated abnormal operation of 
the component. At least one source of additional information, e.g., the time and date, may be provided and 
input means coupled to the vehicle for inputting the additional information into the processor means. The 
another system may also be a warning device including transmission means for transmitting information 
related to the component abnormal operating state to a site remote from the vehicle, e.g., a vehicle repair 
facility. 

In another embodiment of the component diagnostic system discussed above, at least one sensor 
detects a signal containing information as to whether the component is operating normally or abnormally 
and outputs a corresponding electrical signal. Processor means are coupled to the sensor(s) for receiving 
and processing the electrical signal(s) and for determining if the component is operating abnormally based 
thereon. The processor means preferably comprise a pattern recognition algorithm for analyzing a pattern 
within the signal detected by each sensor. Output means are coupled to the processor means for affecting 
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another system within the vehicle if the component is operating abnormally. The another system may be a 
display as mentioned above or a warning device. 

A method for automatically monitoring one or more components of a vehicle during operation of 
the vehicle on a roadway entails, as discussed above, the steps of monitoring operation of the component in 
5 order to detect abnormal operation of the component, e.g., in one or the ways described above, and if 
abnormal operation of the component is detected, automatically directing the vehicle off of the restricted 
roadway. For example, in order to automatically direct the vehicle off of the restricted roadway, a signal 
representative of the abnormal operation of the component may be generated and directed to a guidance 
system of the vehicle that guides the movement of the vehicle. Possibly the directing the vehicle off of the 

10 restricted roadway may entail applying satellite positioning techniques or ground-based positioning 

techniques to enable the current position of the vehicle to be determined and a location off of the restricted 
highway to be determined and thus a path for the movement of the vehicle. Re-entry of the vehicle onto the 

''^ restricted roadway may be prevented until the abnormal operation of the component is satisfactorily 
addressed. 

1§ Although several preferred embodiments are illustrated and described above, there are possible 

\Z combinations using other signals and sensors for the components and different forms of the neural network 
i;n implementation or different pattern recognition technologies that perform the same functions which can be 
utilized in accordance with the invention. Also, although the neural network and modular neural networks 
l== have been described as an example of one means of pattern recognition, other pattern recognition means 
20i exist and still others are being developed which can be used to identify potential component failures by 
□ comparing the operation of a component over time with patterns characteristic of normal and abnormal 
component operation. In addition, with the pattern recognition system described above, the input data to 
the system may be data which has been pre-processed rather than the raw signal data either through a 
process called "feature extraction" or by various mathematical transformations. Also, any of the apparatus 
25 and methods disclosed herein may be used for diagnosing the state of operation or a plurality of discrete 
components. This invention is not limited to the above embodiments and should be determined by the 
following claims. 
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